A Multimodal Dialogue System for Medical Decision Support inside Virtual Reality
نویسندگان
چکیده
We present a multimodal dialogue system that allows doctors to interact with a medical decision support system in virtual reality (VR). We integrate an interactive visualization of patient records and radiology image data, as well as therapy predictions. Therapy predictions are computed in realtime using a deep learning model.
منابع مشابه
A Decision Support System for Urban Journey Planning in Multimodal Public Transit Network
The goal of this paper is to develop a Decision Support System (DSS) as a journey planner in complex and large multimodal urban network called Rahyar. Rahyar attempts to identify the most desirable itinerary among all feasible alternatives. The desirability of an itinerary is measured by a disutility function, which is defined as a weighted sum of some criteria. The weight...
متن کاملSpeech-based Medical Decision Support in VR using a Deep Neural Network (Demonstration)
We present a speech dialogue system that facilitates medical decision support for doctors in a virtual reality (VR) application. The therapy prediction is based on a recurrent neural network model that incorporates the examination history of patients. A central supervised patient database provides input to our predictive model and allows us, first, to add new examination reports by a pen-based ...
متن کاملBaby Steps From GUI Towards Dialogue: Mixed-Initiative Computerese
Initiative and control are crucial issues even in computereses, the very basic implementations of speech which handle tasks in traditional computer applications. Our “Baby Steps” dialogue system uses a context-based approach to handle initiative decisions when faced with noisy input sensors, dangerous and irreversible actions, and multiple input/output modalities. We are studying Microsoft Powe...
متن کاملDetermining Components of Medical Instructional Design based on Virtual Reality by Research Synthesis
Introduction: The purpose of the present study was to determine the components of medical education design based on virtual reality by research synthesis method. Methods: In the present study a synthesis method was used. In order to study the research background and to collect appropriate data among the databases of Science Direct, Springer, Scopus, ProQuest and Eric (ERIC) search. With the ke...
متن کاملDesign and Implementation of a Semantic Dialogue System for Radiologists
This chapter describes a semantic dialogue system for radiologists in a comprehensive case study within the large-scale MEDICO project. MEDICO addresses the need for advanced semantic technologies in the search for medical image and patient data. The objectives are, first, to enable a seamless integration of medical images and different user applications by providing direct access to image sema...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2017